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ABSTRACT 



During the 1990s, Virginia implemented statewide Standards 
of Learning, but several school districts did not have the capacity to meet 
these new content and performance standards. In 1996, a "high-need" rural 
Virginia school district was selected as a development site where elements of 
a technical assistance system to improve student achievement could be devised 
and tested. Before site work began, three instruments were administered to 
faculty members to provide a baseline description of the district's capacity 
to engage in improvement initiatives. The instruments measured staff 
perceptions of staff empowerment, the existence of a schoolwide professional 
community, and organizational effectiveness. In April 1999, the instruments 
were combined into a single survey and administered again to 80 of the 
district's 89 staff to measure changes after 2 years of technical assistance. 
This report summarizes findings from that posttest. Overall, the results 
indicate that the district expanded its organizational capacity by making 
concrete progress in the area of teacher empowerment and by making minimal 
progress in the areas of creating sustainable professional learning 
communities and increasing organizational effectiveness. (Contains the survey 
questionnaire and extensive data tables and figures.) (SV) 
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ABSTRACT 



In 1996, AEL staff collaborated with Virginia 
Department of Education staff to select a high-need 
school division (district) willing to serve as a develop- 
ment site where elements of a technical assistance 
system to improve students’ academic performance 
could be devised and tested. The “Rural County 
Public Schools” (RCPS, pseudonym) met the selection 
criteria, and includes one elementary school, one 
middle school, and one high school. 

During the 1996-97 school year, three instru- 
ments were administered to faculty members to 
measure the construct of “organizational capacity”: 
the “School Participant Empowerment Scale” (SPES), 
the “School-Wide Professional Community Survey” 
(SWPC), and the “Index of Perceived Organizational 
Effectiveness” (IPOE). As a posttest, the instruments 
were administered again in April 1999 to measure 
changes after two years of technical assistance. This 
report summarizes findings from that posttest. 



The SPES showed four statistically significant 
subscale gains from the pretest, with medium to large 
effect sizes, and three statistically significant 
differences among the schools in 1999, with small 
effect sizes. The SWPC did not show any statistically 
significant differences from the pretest or among the 
schools in 1999. The IPOE showed a statistically 
significant decrease from the pretest, with a large 
effect size, as well as a statistically significant 
difference among the schools in 1999, with a small 
effect size. 

Given the instrumentation used in this study, we 
conclude that overall, since 1997, the RCPS division 
has expanded its organizational capacity by makin g 
concrete progress in the area of teacher empowerment 
and minimal progress in the areas of creating 
sustainable professional learning communities and 
increasing organizational effectiveness. 
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EXECUTIVE SUMMARY 



During the past decade, the Commonwealth of 
Virginia has taken significant steps to measure and 
increase student achievement by implementing the 
Standards of Learning (SOLs). However, several 
school divisions (districts) across the state did not 
have the capacity to meet new content and perform- 
ance standards. AEL, Inc., is assisting Virginia by 
conducting research to better understand the process 
of providing technical assistance to high-need schools. 
In 1996, project staff collaborated with the Virginia 
Department of Education to identify and select a high- 
ne^ school division willing to serve as a development 
site where elements of a technical assistance system to 
improve students’ academic performance could be 
devised and tested. 

The “Rural County Public Schools” (RCPS, 
pseudonym), located in south central Virginia, met the 
selection criteria and was willing to work with AEL 
on this project. The division contains one elementary 
school (prekindergarten-grade S), one middle school 
(grades 6-8), and one high school (grades 9-12). 

During the 1996-97 school year, three instruments 
were administered to faculty members to measure the 
construct of “organizational capacity.” The results 
provided a baseline description of the three schools 
before intensive site work began. The 12 dimensions 
measured by the instruments focus on the capacity 
of the organization to engage in improvement 
initiatives and attributes that schools must possess to 
improve student achievement and sustain continuous 
improvement. 

As a posttest, the instruments were administered 
again in 1999 to measure changes after two years of 
technical assistance delivery; however, the surveys 
were combined into ‘The Teacher, School, and School 
Organization Questionnaire” to eliminate superfluous 
paperwork and repetitive demographic questions. The 
survey was administered in April 1999 at two staff 
meetings (one for elementary faculty and one for 
middle and high school faculty), with no follow-up 
contact. All 89 staff members who attended either 
meeting completed the instrument. Of these, 80 were 
usable and comprise the final data set (usable return 
rate of 90%). This report summarizes findings from 
that posttest. 

The “School Participant Empowerment Scale” 
(SPES) was developed by Short and Rinehart in 1992. 
As re-factored by decker and Loadman in 1995, this 
39-item instrument contains six subscales: Decision 
Making, Status with Colleagues, Professional Growth, 
Self-Efficacy, Autonomy in Scheduling, and Impact. 
Response options were presented as a 5-point Likert- 
type scale of 1 (Strongly Disagree) to 5 (Strongly 
Agree). 



The “School-Wide Professional Community 
Survey” (SWPC) was developed based on work and 
items published by Louis, Marks, and Kruse in 1996. 
AEL staff developed a 22-item instrument with a 5- 
point Likert-type response scale of 1 (Strongly 
Disagree) to 5 (Strongly Agree) for each item. The 
instrument includes five subscales: Shared Sense of 
Purpose, Collaborative Activity, Collective Focus on 
Student Learning, Deprivatized Practice, and Reflec- 
tive Dialogue. 

The “Index of Perceived Organizational Effec- 
tiveness” (IPOE) was developed by Mott in 1972 and 
contains eight items that assess five dimensions of 
organizational effectiveness: quantity of product or 
service (i.e., lesson plans, curriculum, instruction, 
etc.); quality of product or service; efficiency; 
adaptability; and flexibility. The instrument utilizes a 
5-point Likert-type response option of 1 to 5 for each 
item (a higher score indicates a higher perception of 
that item), yielding a total score. 

Descriptive statistics are reported by individual 
schools at the subscale level, although individual item 
analyses are provided in portraits provided for each 
school. One-way analyses of variance were computed 
to compare subscale means among the three schools. 
Correlations were produced to examine the relation- 
ships among the demographic variables and the three 
instruments, as well as among the instruments them- 
selves. Independent samples t tests were computed to 
compare pre- and posttest findings (match^ pairs 
were not used since the division experienced a 35% 
turnover in faculty since the 1997 pretest). Effect 
sizes were also calculated for significant findings. 

The SPES instrument showed four statistically 
significant subscale gains from the 1997 pretest to the 
1999 posttest, all with medium to large effect sizes. It 
also showed three statistically significant differences 
among the 1999 school levels (elementary, middle, 
and high), with small effect sizes. The SWPC 
instrument did not show any statistically significant 
differences either between the 1997 and 1999 
administrations or among the 1 999 schools. The IPOE 
instrument showed a statistically significant decrease 
from the pretest to the posttest, with a large effect size, 
as well as a statistically significant difference among 
the 1999 schools that resulted in a small effect size. 

A moderate positive correlation was present among 
the three instruments, indicating a connection among 
empowerment, professional community, and perceived 
school effectiveness. Low to moderate positive correla- 
tions were found for 10 of the 1 1 process-oriented SPES 
and SWPC subscales to the behavioral capacity IPOE 
variable of perceived school effectiveness, indicating 
this score increased as other subscale values rose. 
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Conclusions. Given the Cronbach alpha 
reliability estimates obtained for the posttest scores, 
we conclude there was satisfactory reliability in this 
administration of the three instruments. 

Since 1997, the project’s technical assistance 
interventions may have had an impact on several of 
the areas under study. Based on the high school 
teachers’ increased scores in decision nnaking, self- 
efficacy, status, and impact, we conclude that 
in^roved conditions and practices at the high school 
have led to a heightened sense of empowerment, 
recognizing that a change in leadership may also have 
influenced perceptions of empowerment. 

Based on the slight fluctuations in teachers’ mean 
scores from 1997 to 1999, it can be concluded that there 
was little measurable change in the area of professional 
learning community. Further, based on the consistent 
1999 ratings by the elementary, middle, and high school 
teachers, we telieve that a division-wide consensus of 
mediocrity exists in this area, which may be difficult to 
ameliorate given the high faculty turnover rate. 

Based on the decline in middle school teachers’ or- 
ganizational effectiveness score since 1997, we conclude 
that their perceptions have become more discerning over 
the past two years. Possibly, as they became more aware 
of the elements that comprise organizational effective- 
ness, they developed a more realistic view of existing 
school conditions, resulting in a decreased score. Given 
the minimal changes in the elementary and high school 
teachers’ scores since 1997,webelievethatteacherview- 
points in those schools remained constant Furthermore, 
irrqrrovement may be difficult to achieve in this area, 
given teachers’ low perceptions of the ability of their 
faculties to modify behaviors as a result of ch^ge. 

Based on 1999 scores, we conclude that high school 
teachers perceived themselves to have greater decision- 
making authority than did the elementary teachers, both 
the middle and high school teachers had higher 
perceptions of status than did the elementary teachers, 
and the elementary teachers experienced more autonomy 
in scheduling than did either ffie middle or high school 
teachers. Furthermore, the high school teachers had 
higher (but still relatively riKxlerate) perceptions of their 
school’s organizational effectiveness than did either the 
elementary or middle school teachers. 

The lowest-scoring subscale in 1999 (and 1997) 
was deprivatized practice; therefore, it can be con- 
cluded that this area merits further investigation of 
existing division conditions. The middle school 
teachers’ declining score further substantiates the need 
to identify barriers to shared-practice techniques such as 
peer coaching, team teaching, or class observations. 

Given the instrumentation used in this study, we 
conclude that overall, since 1997, the RCPS division has 
expanded its organizational capacity by making concrete 
progress in the area of teacher en^werment and 
mirumal progress in the areas of creating sustainable 
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professional learning communities and increasing 
organizational effectiveness. 

Recommendatioiis. Staff need to examine 
conditions, especially at the middle school, that in^ede 
the deprivadzation of practice and try to remove those 
hurdles in order to create a nonthreatening environment 
for teachers to participate in classroom visits. 

District and school conditions should be examined 
to identify barriers that seem to preclude creating a 
sustainable professional learning community. 

need to explore district and school conditions, 
especially at the middle school, that may inq)ede efforts 
to increase organizational effectiveness and t^ toremove 
those hurdles in order to facilitate inqrrovement 

Teachers should be involved in discussions about 
ways to retain staff and decrease the high turnover rate. 

Administrators need to provide time and establish 
expectations for teachers to work together to make 
decisions about the K-12 curriculum and instruction. 

Teachers need to ensure that they are teaching 
higher-level skills by incorporating these skills into the 
curriculum. Otherwise, it is unlikely that students will 
pass the Standards of Learning assessments, which 
require such skills, and thus will not be prepared to enter 
the workforce of the 21st century. 

School administrators should focus on developing 
opportunities for collaboration between themselves and 
teachers, and on supporting teachers’ efforts to collab- 
orate with their peers both within and among schools. 

As the district responds to the state guidelines in 
order to maintain accreditation, teachers and administra- 
tors must develop the skill of collabwating with staff in 
other schools in order to offer students the types of activ- 
ities and curriculum elements that will lead to successful 
performance on the Standards of Learning assessments. 

School structures/processes that encourage teachers 
to share ideas and leam from one another are essential 
for building collaboration and need to be put in place. 

Administrators should continue providing conunon 
plarming periods for teachers and ensuring use of that 
time for collaboration on instructional themes, activ- 
ities, and lesson plans within schools and grade levels. 

Administrators and others need to lead teachers 
toward a collective focus on student learning. 

Teachers need more time to spend together 
discussing the irrprovement of teaching and learning in 
their respective schools. 

Staff need to be involved in articulating the shared 
beliefs, goals, and values of the division as a whole and 
of the individual schools. 
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INTRODUCTION 



Research has shown the need for focusing efforts 
to reform American public schools at the school level 
rather than at the individual student or teacher level 
(Coleman et al., 1 966; National Commission on Excel- 
lence in Education, 1983). Of particular concern is 
the capacity of school systems to help all students 
reach high standards of achievement. But what is 
“capacity”? Traditional usage defines it as “the ability 
to do something,” but it also means “the maximum or 
optimum amount of production” (Corcoran & Goertz, 
1995, p. 27). Thinking about school capacity as the 
maximum level of production focuses attention on the 
results rather than the means of school reform. And, 
these results need to be sustained — “new levels of 
results that continue to be generated over time” 
(Digate & Rhodes, 1995, p. 34). 

One salient goal of these reform efforts is the 
establishment of professional communities within 
schools (Newmann & Wehlage, 1995). Darling- 
Hammond (as cited in Corcoran & Goertz, 1995) 
states that “capacity building means the creation of 
learning communities, changes in governance, and 
opportunities for teachers to share their craft 
knowledge” (p. 27). Further, Corcoran and Goertz 
note that “collegiality, collaboration, and cooperation 
can be viewed as multipliers that enhance the value of 
human capital and instructional resources . . . and 
increase human capital through the sharing of ideas 
and practices” (p. 28). 

Although factors such as curriculum alignment, 
raising standards and expectations, and altering 
decision-making structures are necessary and 
important components, none is sufficient in and of 
itself to raise and sustain continuous improvement in 
student achievement. Researchers are now closely 
examining various aspects of the school environment 
to gain further understanding of factors affecting 
student achievement. 

Facing a plethora of complicated reform efforts 
available as potential solutions to the complex 
problem of school improvement, practitioners may 
quickly become overwhelmed (Nilsen, 1999). As a 
result, state departments of education are creating 
technical assistance frameworks responsive to school 
district needs. 



During the past decade, the Commonwealth of 
Virginia has taken significant steps to measure and 
increase student achievement by implementing the 
Standards of Learning (SOLs). However, several 
school divisions (equivalent to districts) across the 
state did not have the capacity to meet new content 
and performance standards. AEL, Inc., is assisting 
Virginia by conducting research to better understand 
the process of providing technical assistance to high- 
need schools. 

Project Background 

In 1996, AEL project staff collaborated with the 
Virginia Department of Education to identify and 
select a high-need school division willing to serve as 
a development site where elements of a technical 
assistance system to improve students’ academic 
performance could be devised and tested (Nilsen, 
1999). The overarching purpose of this project is to 
learn more about the technical assistance process of 
assisting high-need schools to develop the organi- 
zational capacity to support effective school 
performance and to enhance the intellectual quality of 
student learning (AEL, 1998). The project has two 
main goals: ( 1 ) to gain an understanding about how to 
best support high-need schools to develop the 
organizational capacity to support effective school 
performance and enhance student performance on the 
Virginia Standards of Learning; and (2) to recommend 
to the Virginia Department of Education a system/ 
framework of technical assistance that will support 
high-need schools to develop the organizational 
capacity to support effective school performance and 
enhance student performance on the Virginia 
Standards of Learning. 

High-need schools were defined as those in which 
the initial pass rate on Virginia’s Literacy Passport 
Test (LPT) fell below 50%, and which met certain 
other sociodemographic criteria. Schools unlikely to 
pass the LPT were located in rural regions with high 
poverty levels (22% of children), low educational 
attainment of adults (48% lacking high school 
equivalency), and almost twice as many children (7% 
versus 4%) identified as “at risk” (defined by the 
National Center for Education Statistics as living in a 
single-parent household in which the adult lacks a 
high school diploma and has an income below the 
poverty line) (as cited in AEL, 1995). 
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The “Rural County Public Schools*” (RCPS), 
located in south central Virginia, met the selection 
criteria of a high-need school division and was willing 
to work with AEL on this project. During the 1 998-99 
school year, RCPS had a student enrollment of 
approximately 1,300 students. The three public 
schools in the county include one elementary school 
(prekindergarten through grade 5), one middle school 
(grades 6 through 8), and one high school (grades 9 
through 12). 

AEL staff are collaborating with RCPS in 
developing and testing a technical assistance model 
that builds local capacity to support continuous 
improvement in student performance. If effective, this 
approach will be recommended to AEL’s resident 
director. Most of the work to date has addressed 
curriculum alignment with classroom instruction and 
the Standards of Learning. David Squires, a consul- 
tant from Yale University, worked with RCPS during 
1997-98 on aligning the English curriculum and 
during 1998-99 on aligning the mathematics 
curriculum. 

Since the 1996-97 survey administration, RCPS 
schools have experienced changes that may have 
impacted school improvement. In particular, there has 
been a 35% faculty turnover in the past two years, and 
a change in leadership at the high school. As well, 
project activities have been designed and imple- 
mented in the interim. Project staff have provided 16 
days of staff development, sponsored RCPS staff 
attendance at a conference on professional communi- 
ties, and delivered other technical assistance support 
as requested. School staff have aligned and balanced 
both the language arts and mathematics curricula. 
Project staff have participated in meetings, interviews, 
conference calls, and classroom observations in their 
attempts to help RCPS staff improve their organ- 
izational capacity. Electronic curriculum databases 
have been developed and are now in use. 

Project staff are working closely with AEL’s 
resident director in Virginia to share knowledge 
gained from this site with similar divisions across the 
state. Project staff are also working toward sharing 
knowledge gained with regional and nationwide 
audiences. Such efforts include presentations at 
conferences such as the American Evaluation 
Association, the American Educational Research 



Association, and the Association for Supervision and 
Curriculum Development. 

Pretest Information 

In collaboration with the Virginia Department of 
Education staff, AEL project and evaluation staff 
selected three instruments to measure the construct of 
“organizational capacity.” These surveys were admin- 
istered to RCPS faculty members during the 1996-97 
school year. The results provided a baseline descrip- 
tion of the three schools before intensive site work 
began (Nilsen, 1999). This pretest administration was 
intended to determine if AEL’s approach was 
successful at increasing the capacity of the school 
division to support effective school performance, the 
project’s first goal. 

The 12 dimensions measured by the instruments 
focus on the capacity of the organization to engage in 
improvement initiatives and attributes that schools must 
possess to improve student achievement and sustain 
continuous improvement. Project staff hypothesized 
that the schools’ culture would need to change 
dramatically in order to gain the organizational capacity 
to initiate and sustain continuous improvement at the 
conclusion of the project. Teachers would need to be 
empowered to make decisions about teaching and 
learning, and schools would need structures to support 
professional learning communities in order for teachers 
to develop perceptions of their schools as effective. 

Report Purpose and Audience 

As a posttest, the three instruments were 
administered again in 1999 to measure changes after 
two years of technical assistance delivery. This report 
summarizes findings from that posttest. 

The intended primary audience of this report 
includes AEL project and evaluation staff, division 
faculty and administrators, and Virginia Department 
of Education staff. In particular, one section of this 
report, the individual school portraits, is designed 
specifically for faculty members at each of the respec- 
tive schools. Secondary audiences might include 
those interested in teacher efficacy, professional 
learning communities, organizational effectiveness or 
capacity, school improvement, student achievement, 
and/or technical assistance. 



*In order to maintain confidentiality, a pseudonym is used throughout this report for the high-need school division. 



O 

ERIC 



12 



3 



METHODOLOGY 



This section presents demographic information on 
the RCPS professional staff involved in the project, 
descriptions of the three instruments used in this 
posttest, and data collection procedures and analyses. 

Description of the Population 

The three RCPS schools included one elementary 
school (prekindergarten through grade 5), one middle 
school (grades 6 through 8), and one high school 
(grades 9 through 12). Not all staff members were 
housed in a single building; a number of specialty 
teachers and other certified staff worked across 
schools. All 89 of the staff members eligible to 
participate in this round of data collection (who 
attended one of the two staff meetings where surveys 
were administered) completed surveys. Of these 89, 
7 were dropped from the final data set because the 
respondents worked in more than one school building, 
and 2 were dropped because respondents did not 
provide school-level information. The final number 
included in this report consists of 80 respondents 
(90% usable return rate): 70 classroom teachers, 3 
Title I teachers, 2 guidance counselors, 1 department 
head/chair, 1 special education teacher, 1 resource 
teacher, and 2 respondents who did not provide their 
job titles. 

Exactly half (40) of the respondents indicated they 
worked at the elementary school; the remainder were 
fairly equally distributed between the middle school 
(21, 26%) and the high school (19, 24%). The 80 
respondents show a marked turnover rate for 
RCPS — ^almost half (34, 43%) indicated they were not 
working at their respective schools in April 1997 
when the pretest was given. All but one (79, 99%) 
indicated they worked full time. Of the 67 respon- 
dents who provided the subject(s) they taught, almost 
a third (21,31%) were teaching all subjects. 

The majority of respondents (65, 82%) were 
female, the remainder were male. Forty-one (5 1 %) of 
the participants had a bachelors degree, followed by 
bachelors + 1 5 units (13,1 6%), masters (2 1 , 26%), and 
masters +15 units (5, 6%). The respondents’ ages 
ranged from 23 to 60 (standard deviation of 10 years), 
with an average age of 37; 50% of the respondents 
were at or below the age of 35. 

Respondents had been teaching an average of 9 
years (standard deviation of 8.8 years), with an 
average of 6 years at their current school (standard 



deviation of 6.7 years) and an average of 7 years in the 
RCPS district (standard deviation of 7.3 years). About 
half had been in the teaching profession for 5 years or 
less, and fewer than 20% had been teaching for 20 or 
more years. 

Data Collection Instruments 

In the 1996-97 pretest, three separate instruments 
were administered to the professional staff of RCPS. 
These surveys were a cost-effective way to collect 
valid and reliable information on teachers’ impres- 
sions of the environment and effectiveness of the 
schools in which they worked. As a whole, the instru- 
ments provided a comprehensive baseline picture of 
the organizational capacity of the three faculties to 
engage in ongoing school improvement efforts to raise 
student achievement on the Virginia Standards of 
Learning. The three instruments included the “School 
Participant Empowerment Scale,” the “School-Wide 
Professional Community Survey,”, and the “Index of 
Perceived Organizational Effectiveness.” 

One caution should be noted about the use of 
these instruments. While content validity has clearly 
been established through previous research, the 
surveys are not without inherent problems. Namely, 
meta-analysis of the pretest report found that “two 
serious deficiencies or errors often found in survey 
research were prevalent with the instruments” 
(Western Michigan University, 2000, p. 59). These 
errors included several multiple-concept items and 
several items with inappropriate response options. 
But, report author William Wiersma concluded that 
“because the basic content of the items had content 
validity, it can be inferred that validity of the data was 
adequate” (p. 62). 

In an effort to streamline the data collection for 
the posttest administration, the three surveys were 
combined into one, “The Teacher, School, and School 
Organization Questionnaire.” This combined survey 
was six pages in length, and eliminated superfluous 
paperwork and repetitive demographic questions. 
Otherwise, the survey contained the same information 
as the original three surveys. Demographic questions 
retained included role, subjects taught, school level 
taught, full or part time, years taught at current school, 
years taught in district, total years teaching 
experience, educational attainment, gender, and age. 
Specific information on each of the three surveys is 
presented next. 
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School Participant Empowerment Scale (SPES) 

The 38-item SPES survey was developed by 
Short and Rinehart in 1992 with a small sample of 
teachers at one grade level. In 1995, Klecker and 
Loadman (1996) used the instrument with a large 
sample of teachers (4,091) from 183 Ohio schools. 
They re-factored the original instrument into six 
differently-named factors, which were used in this 
report: (1) Decision Making, (2) Status with Col- 
leagues, (3) Professional Growth, (4) Self-Efficacy, 



(5) Autonomy in Scheduling, and (6) Impact. See 
Table 1 for SPES items and subscales. 

The response options on the SPES were presented 
as a 5-point Likert-type scale of 1 (Strongly Disagree) 
to 5 (Strongly Agree). In prior AEL research, the 
Professional Growth subscale had unsatisfactory relia- 
bility scores; therefore, the lowest item was deleted and 
two new items were added (Meehan & Cowley, 1998). 
As a result, both the pretest and posttest versions of the 
SPES used in this project consisted of 39 items. 



Table 1 : SPES Instrument Subscale Composition 



Subscale 



Decision 

Making 



Status with 
Colleagues 



Professional 

Growth 



Self-Efficacy 



Autonomy in 
Scheduling 



1 . 

7. 

11 . 

13. 

17. 

21. 

25. 

26. 



2 . 

3. 

8 . 

15. 

22 . 

23. 



12 . 

14. 

16. 

18. 

20. 



4. 

6 . 

9. 

10. 

19. 

24. 

28. 

29. 

30. 
33. 
35. 
37. 



5. 

31. 

36. 



Impact 



27. 

32. 

34. 

38. 

39. 



Item 



I am given the responsibility to monitor programs. 

I make decisions about the implementation of new programs in school. 
I am able to teach as I choose. 

I make decisions about the selection of other teachers for my school. 

I have the freedom to make decisions on what is taught. 

I am involved in school budget decisions. 

I make decisions about curriculum. 

I am a decision maker. 



I function in a professional environment. 

I believe that I have earned respect. 

I am treated as a professional. 

I have the respect of my colleagues. 

I work at a scnool where kids come first. 

I have the support and respect of my colleagues. 



I participate in staff development. 

I have the opportunity for professional growth. 

I feel that I am involved in an important program for children. 

I have grown professionally during the past year. 

I believe in the value of professional development for teachers. 



I believe that I am helping kids become independent learners. 

I believe that I have the ability to get things done. 

I believe that I am very effective. 

I believe that I am empowering students. 

I believe that I am having an impact. 

I see students learn. 

I have a strong knowledge base in the areas in which I teach. 

I believe that I have the ability to grow by working daily with students. 
I perceive that I have the opportunity to influence others. 

I perceive that I am making a difference. 

I believe that I am good at what I do. 

I perceive that I am having an impact on other teachers and students. 



I have control over daily schedules. 
I can determine my own schedule. 

I can plan my own schedule. 



I am given the opportunity to collaborate with other teachers. 

I have the opportunity to collaborate with other teachers in my school. 
Principals, other teachers, and school personnel solicit my advice. 

My advice is solicited by others. 

I have an opportunity to teach other teachers about innovative ideas. 
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schedules). Overall, these reliabilities were very 
similar to those found in the pretest, with two 
subscales increasing slightly by .02 and four subscales 
decreasing (by no more than .06). 

Table 2 also provides reliability estimates for the 
scores obtained by each school level. In general, the 
estimates for the secondary school scores are the 
highest, while those for the elementary school scores 
are the lowest. Of particular note are the differences 
between the reliabilities for the Decision Making and 
Impact subscale scores for the elementary and 
secondary schools. 



Table 2: Cronbach Alpha Reliability Estimates of the 



SPES and SWPC Subscales and the IPOE Total Scale 



Instrument Name 


Subscale Name 


n 


No. 

Items 


Overall 

Alpha 


Elem. 

Alpha 


Mid. 

Alpha 


Sec. 

Alpha 


School Participant 


Decision Making 


78 


8 


.67 


.50 


' .66 


.82 


Empowerment Scale 


Status with Colleagues 


80 


6 


.76 


.74 


- .69 


.76 


(SPES) 


Professional Growth 


80 


5 


.66 


.52 


.76 


.70 


Self-Efficacy 


76 


12 


.89 


.84 


.89 


.93 




Autonomy in Scheduling 


80 


3 


.81 


.76 


.76 


.83 




Impact 


79 


5 


.67 


.48 


.71 


.86 


School-Wide 


Shared Sense of Purpose 


79 


5 


.82 


.77 


.91 


.77 


Professional 


Collaborative Activity 


76 


6 


.71 


.54 


.84 


.82 


Community (SWPC) 


Collective Focus on 
Student Learning 


80 


6 


.87 


.73 


’ .95 


.69 




Deprivatized Practice 


79 


7 


.80 


.79 


.82 


.76 




Reflective Dialogue 


77 


6 


.80 


.78 


.89 


.74 


Index of Perceived 
Organizational 
Effectiveness (IPOE) 


Total Scale 


77 


8 


.87 


.85 


.90 


.66 



School-Wide Professional Community Survey 
(SWPC) 

This instrument was developed based on work and 
items published by Louis, Marks, and Kruse in 1996 
on professional learning communities. Based on their 
paper, AEL staff developed a 22- item instrument with 
a 5-point Likert-type response scale of 1 (Strongly 
Disagree) to 5 (Strongly Agree) for each item. This 
survey included five subscales: (1) Shared Sense of 
Purpose, (2) Collaborative Activity, (3) Collective 
Focus on Student Learning, (4) Deprivatized Practice; 



and (5) Reflective Dialogue. (See Table 3 for 
subscale composition.) 

Low subscale Alpha reliability estimates were found 
in prior research (Meehan &“Cowley, 1998), so six new 
items were added in the pretest administration, making a 
total of 28. For the posttest, two additional items were 
added to the Deprivatized Practice subscale to 
differentiate between peer observations from within and 
outside the school, both as an observer and as an 
observee. Therefore, this posttest administration of the 
SWPC contained 30 items. 



Table 2 provides overall Cronbach Alpha 
reliability estimates (the degree to which items 
measure the same construct) for the obtained scores 
for each of the six SPES subscales. Two of the 
subscales had reliabilities in the .80s, one was in the 
.70s, and three were in the .60s (Decision Making and 
Impact at .67 and Professional Growth at .66). All 
items in these three subscales contributed to the 
reliability except for one item in Professional Growth 
(I participate in staff development); the subscale 
reliability would have increased slightly to .69 if this 
item was dropped. The Autonomy in Scheduling 
subscale Alpha of .81 would have risen to .90 if one 
item was dropped (I have control over daily 
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Table 3: SWPC Instrument Subscale Composition 



Subscale 


Item 


Shared Sense of 
Purpose 


40. Most of my colleagues share my beliefs and values about what the central mission of the school 
should be. 

41. Goals and priorities for the school are clear. 

42. The district’s vision for its schools is accepted by teachers and administrators. 

43. In the district’s schools, the teachers and the administration are in close agreement on 
achievement standards and grading policies. 

44. There is close agreement among teachers and administrators on expectations for student 
learning in this district. 


Collaborative 

Activity 


45. I receive many useful suggestions for curriculum materials from colleagues in my school, 
department, unit, or district. 

46. I receive many useful suggestions for teaching techniques or student activities to share from 
colleagues in my school, department, unit, or district. 

47. There is a great deal of cooperative effort among staff members in my school, department, 
unit, or district. 

48. I make a conscious effort to coordinate the content of my courses across the district’s 
schools. 

49. In a typical planning period with others in my district, the group decides common themes 
and suggests related materials ^d activities to guide instruction in the district’s schools. 

50. I meet often with others in my district regarding lesson planning, curriculum development, 
guidance/counseling, evaluation of programs, or other collaborative work related to 
instruction. 


Collective 
Focus on 
Student 
Learning 


51. Higher level skills (reasoning, problem solving, critical thinking) are important student goals 
of our district’s students. 

52. Creative thinking is an important student goal for our district’s students. 

53. Teachers in our district focus on what and how well students are learning rather than on how 
they are teaching. 

54. Teachers in our district exhibit a reasonably focused commitment to authentic curriculum 
and instruction. 

55. Teachers in our district exhibit a reasonably focused commitment to authentic assessment. 

56. A focused school vision for student learning is shared by most staff in the schools in our 
district. 


Deprivatized 

Practice 


57. Two or more colleagues in the building regularly observe my work in schools and give me 
meaningful feedback. 

58. Other than formal evaluation, my supervisor(s) regularly observe(s) my work in schools and 
give(s) me meaningful feedback. 

59. I have often been visited by a peer from another school to observe and discuss my 
teaching/leaming situation. 

60. I have often been visited by a peer from another classroom to observe and discuss my 
teaching/leaming situation. 

61. I have often visited a peer’s school to observe and discuss his/her teaching/leaming situation. 

62. I have often visited a peer’s classroom to observe and discuss his/her teaching/leaming 
situation. 

63. I receive informal, meaningful feedback on my performance from my peers. 


Reflective 

Dialogue 


64. In a typical planning period with other teachers, the group discusses problems of specific 
students and arranges appropriate help. 

65. In a typical planning period with other teachers, the group discusses specific teaching 
practices and behaviors of team members in our district. 

66. In formal and informal meetings of peers, the group discusses the goals of the schools in our 
district. 

67. In formal and informal meetings of peers, the group discusses the teaching profession. 

68. In formal and informal meetings of peers, the group discusses how students learn. 

69. In formal and informal meetings of peers, the group discusses the evaluation of student 

learning. 
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Table 2 provides overall Cronbach Alpha 
reliability estimates for the obtained scores for each of 
the five SWPC subscales. Four of the subscales had 
reliabilities at or above .80, whereas Collaborative 
Activity was the lowest at .71. Most of the items in 
these five subscales contributed to the reliabilities, 
although deletion of one item each in four of the 
subscales would have resulted in minute increases in 
Alpha. Overall, these reliabilities were very similar to 
those found in the pretest, with two subscales 
increasing by .03 and .07 and three subscales 
decreasing (by no more than .06). 

Table 2 also provides reliability estimates for the 
scores obtained by each school level. In general, the 
estimates for the middle school scores are the highest, 
while those for the secondary school scores are the 
lowest. Of particular note is the difference between 
the reliabilities for the Collaborative Activity subscale 
scores for the elementary and middle schools. 



Index ofPerceived Organizational Effectiveness (IPOE) 

This instrument was developed by Paul Mott( 1 972) 
and measures school efficiency and effectiveness and the 
ability to innovate, adapt, and respond. This 8-item 
survey assesses five dimensions of organizational 
effectiveness: (1) quantity of product or service (i.e., 
lesson plans, curriculum, instruction, etc.); (2) quality of 
product or service; (3) efficiency; (4) adaptability; and 
(5) flexibility. (See Table 4 for individual items.) 

This instrument utilizes a 5-point Likert-type 
response option of 1 to 5 (a higher score indicates a 
higher perception of that item), yielding a total score 
ranging from 8 to 40 points. In previous research 
(Meehan & Cowley, 1998), high internal reliability 
estimates (.85 and above) were found. This posttest 
administration had an overall reliability estimate of 
.87 (see Table 2), slightly higherthan the pretest (.84). 
The reliability estimate was highest for the middle 
school score and lowest for the secondary school score. 



Table 4: IPOE Instrument Items 



Item 



70. Of the various things produced by the people you know in your school(s), how much are they producing? 

71 . How good is the quality of the products or services produced by the people you know in your school(s)? 

72. Do the people in your school(s) get maximum output from the available resource (money, people, 
equipment, etc.)? That is, how efficiently do they do their work? 

73. How good a job is done by the people in your school(s) in anticipating problems and preventing them 
from occurring or minimizing their effects? 

74. How informed are the people in your school(s) about innovations that could affect the way they do 
their work? 

75. When changes are made in methods, routines, or equipment, how quickly do the people in your 
school(s) accept and adjust to the changes? 

76. How many of the people in your school(s) readily accept and adjust to the changes? 

77. How good a job do people in your school(s) do in coping with emergencies/disruptions? 



Data Collection Procedures 

“The Teacher, School, and School Organization 
Questionnaire” (three surveys combined) was admin- 
istered to professional staff members in April 1999. 
The survey was distributed at two staff meetings — one 
for elementary faculty and one for the middle and high 
school faculty. No follow-ups were conducted. 

All 89 staff members who attended one of the two 
staff meetings where the surveys were administered 
completed the survey. Of these 89 surveys, 80 were 
usable and comprise the final data set (usable return 
rate of 90%). Teachers were assured that their 
responses would remain anonymous and that results 
would be reported at the school level. 



Data Analyses 

A database was created using SPSS Windows. 
Individual surveys were entered and the data file 
cleaned. Descriptive statistics are reported by 
individual schools at the subscale level only for the 
major focus of this report, although individual item 
analyses are provided inthe'individual school portraits 
depicted later in this report. 

While this study involved a district population and 
not a random sample, inferential statistics were used to 
compare between and within group differences. One- 
way analyses of variance (ANOVA) were computed to 
compare subscale means among the three school levels 
at RCPS (elementary, middle, and high), using the 
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Tukey post-hoc test for comparisons. Pearson 
correlations were produced to examine the relationships 
among the SPES and SWPC subscales and the IPOE 
total scale. Both Pearson and Spearman correlations 
were produced to examine possible relationships among 
the demographic variables and the three instruments. 
Independent samples t tests were computed to compare 
pre- and posttest findings. Matched pairs were not 



conducted since almost half of the respondents had 
started working at their respective school after the pre- 
test administration. And, the focus of the comparison 
was on overall school readiness for improvement, not 
individual gains or losses. Only significant differences 
(Alpha level of .05 or less) are reported for these 
statistical procedures. Effect sizes were also calculated 
for significant t test and ANOVA findings. 
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FINDINGS BY SURVEY 



This section presents findings from administering 
the three instruments to RCPS professional staff 
members in April 1999. These findings are at the 
school level, rather than the individual teacher level, 
since the instruments measured organizational 
capacity of the schools to engage in improvement 
efforts. Findings are organized first by looking at the 
demographic variables in relation to organizational 
capacity, then by survey and subscale for both descrip- 
tive information from this posttest and comparisons to 
the pretest. The last part of this section describes overall 
division findings. 

Demographic Variables and 
Organizational Capacity 

The first analysis looked at possible relationships 
among the demographic variables and the three major 
concepts that comprised organizational capacity: 
teacher empowerment, professional community, and 
school effectiveness. Very few demographic variables 



were associated with organizational capacity to a 
significant degree. 

Professional community scores showed a low 
positive correlation to the gender of the respondents 
(r, = .32,/? < .01), indicating a slight trend of higher 
scores for male respondents when compared with 
those for females. 

School effectiveness scores showed a low positive 
correlation to both the respondents’ age and their 
years of total teaching experience (r = .37,/? < .01; 
r = .23, p < .05). Older or more experienced teachers 
perceived their schools as being more effective than 
did younger or less experienced teachers. As well, the 
level of grades taught correlated positively with 
respondents’ school effectiveness scores (r,= .33, p < 
.01 ), with middle and high school teachers rating their 
schools as more effective than did their elementary 
counterparts. 
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School Participant Empowerment 
Scale (SPES) 

Decision Making 

This 8-item subscale measures the participation of 
teachers in critical decisions that directly affect their 
work. Descriptive statistics for this subscale are 
presented in Table 5. Respondents from all three 
school levels had means in the neutral range (3.23, 
3.38, and 3.61, respectively, for elementary, middle, 
and high), with standard deviations ranging only from 
0.41 to 0.58. ANOVA results show a significant 
difference between the high school and elementary 



responses {F [2, 77] = 3.97, p < .05), indicating that 
the high school teachers experienced a greater degree 
of decision-making authority than did the elementary 
teachers. 

Statistical comparison of the two administrations 
via an independent samples t test revealed a 
significant gain (0.53) for the high school respondents 
from their 1997 score of 3.08 {t [35] = 3.16,p < .01). 
The 1997 score for the middle school teachers (the 
highest of the three 1997 scores at 3.40) dropped 
slightly in 1999 (0.02), as did the 3.32 score for the 
elementary teachers (0.09). See Figure 1 for a visual 
depiction of subscale means by grade level and year. 



Table 5: 1999 Decision Making Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.23 


0.41 


3.25 


-0.336 


Middle 


21 


3.38 


0.52 


3.38 


0.66 


High 


19 


3.61 


0.58 


3.61 


-0.73 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 



Elem< 



Middle- 



High. 



1.00 



Figure 1: Decision Making Subscale 
Means by Grade Level and Year 
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Status with Colleagues 

This 6-item subscale measures teachers’ percep- 
tions of professional respect and admiration of their 
colleagues. Descriptive statistics for this subscale are 
presented in Table 6. Middle and high school teachers 
had almost identical means of 4.17 and 4.16, 
respectively, and the elementary teachers had a score 
of 3.83. Standard deviations were very close, ranging 
only from 0.42 to 0.51. One caution to note is the 
negative skew value above 1.0 (-1.11) for the elemen- 
tary teachers’ score. The value indicates this was not 
a normal distribution of scores, which could be 
attributable to the small sample size. 

ANOVA results show a significant difference 
between the responses (F [2, 77] = 5.66, p < .01), 



indicating middle and high school teachers had higher 
perceptions of status than did the elementary teachers. 
However, even the score of 3.83 shows a generally 
high level of agreement with this concept, suggesting 
a strong sense of collegiality and respect among 
teachers in RCPS. 

Statistical comparison of the two administrations 
via an independent samples t test revealed a 
significant gain (0.36) for the high school respondents 
from their 1997 score of 3.80 {t [35] = 2.00, p = .05). 
Elementary teachers gained only 0.03 from their 1997 
score of 3.80, and the middle school teachers gained 
0.13 from their 4.04 score in 1997. In sum, all three 
groups showed at least a marginal increase from their 
1997 scores. See Figure 2 for a visual depiction of 
subscale means by grade level and year. 



Table 6: 1999 Status with Colleagues Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.83 


0.42 


4.00 


-1.11 


Middle 


21 


4.17 


0.42 


4.00 


0.42 


High 


19 


4.16 


0.51 


4.00 


-0.09 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 



Figure 2: Status with Colleagues Subscale 
Means by Grade Level and Year 
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Professional Growth 

This 5-item subscale measures teachers’ 
perceptions that the school in which they work 
provides them with opportunities to continuously 
increase their skills and knowledge as professionals. 
Descriptive statistics for this subscale are presented in 
Table 7. Means for all three groups were in the 
agreement range, with respective scores of 4.30, 4. 10, 
and 4.27 for the elementary, middle, and high school 
teachers. Standard deviations ranged from .035 for 
the elementary respondents to 0.52 for the middle. 
With only 0.20 between the highest and lowest mean 
scores, there were no significant differences by school 



level of respondent. All three groups were very 
similar in their high level of agreement regarding the 
availability and value of professional growth 
opportunities. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. The 
middle school score dropped 0. 1 1 from 4.21, but both 
the elementary and high school scores increased, from 
4. 19 (0. 1 1) and 4.07 (0.20), respectively. See Figure 
3 for a visual depiction of subscale means by grade 
level and year. 



Table 7: 1999 Professional Growth Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


4.30 


0.35 


4.20 


0.02 


Middle 


21 


4.10 


0.52 


4.00 


0.32 


High 


19 


4.27 


0.46 


4.40 


-0.53 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 



Figure 3: Professional Growth Subscale 
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Self-Efficacy 

This 12-item subscale measures teachers’ 
perceptions that they have the skills and abilities to 
help students learn, are competent in building 
effective programs for students, and can effect 
changes in student learning. Descriptive statistics for 
this subscale are presented in Table 8. Means for all 
three groups were in the agreement range, with 
respective scores of 4.37 (the highest mean for the 
SPES instrument), 4.13, and 4.27 for the elementary, 
middle, and high school teachers. Standard deviations 
ranged only from 0.34 to 0.45. With only 0.24 
between the highest and lowest mean scores, there 



were no significant differences by school level of 
respondent. All three groups were very similar in 
their high level of agreement regarding their 
perceptions of self-efficacy. 

Statistical comparison of the two administrations 
via an independent samples t test revealed a 
significant gain (0.32) for the high school respondents 
from their 1997 score of 3.95 (t [35] = 2.46, p < .05). 
The elementary score increased 0.03 from the 1997 
value of 4.34, but the middle school score decreased 
0.03 from 4.16 in 1997. See Figure 4 for a visual 
depiction of subscale means by grade level and year. 



Table 8: 1999 Self-Efficacy Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


4.37 


0.34 


4.33 


0.16 


Middle 


21 


4.13 


0.45 


4.00 


-0.09 


High 


19 


4.27 


0.42 


4.25 


0.04 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 




Figure 4: Self-Efficacy Subscale 
Means by Grade Level and Year 




□ 1997 

□ 1999 



1.00 2.00 



3.00 4.00 5.00 



Mean 

23 

BESTCOPYAVAIUBLE 



14 



Autonomy in Scheduling 

This 3-item subscale measures teachers’ sense of 
freedom to make decisions that control certain aspects 
of their work life, such as scheduling. Descriptive 
statistics for this subscale are presented in Table 9. 
Middle and high school teachers had similar mean 
scores in the disagreement range, with 2.78 and 2.98, 
respectively (the lowest scores for the SPES 
instrument), although both scores are very close to a 
neutral 3.00. The elementary teachers’ score fell in the 
neutral range at 3.66. Standard deviations were higher 
for this subscale, ranging from 0.80 for the middle 
group to 1.05 for the high school. ANOVA results 



show a significant difference between the responses 
(F [2, 77] = 8.20,p < .01), indicating, not surprisingly, 
that elementary teachers felt more autonomy in 
scheduling than did either the middle or high school 
teachers. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. Both the 
elementary and high school groups increased from the 
1997 scores of 3.59 (0.07) and 2.78 (0.20); the middle 
school score decreased 0.31 from a 1997 score of 
3.09. See Figure 5 for a visual depiction of subscale 
means by grade level and year. 



Table 9: 1999 Autonomy in Scheduling Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.66 


0.83 


4.00 


-0.41 


Middle 


21 


2.78 


0.80 


2.67 


0.31 


High 


19 


2.98 


1.05 


3.00 


-0.41 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 



Figure 5: Autonomy in Scheduling Subscale 



Means by Grade Level and Year 





Mean 
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Impact 

This 5-item subscale measures teachers’ sense that 
they have an effect and influence on school life. 
Descriptive statistics for this subscale are presented in 
Table 10. Means for all three groups were in the 
neutral range, with respective scores of 3.62, 3.77, and 
3.94 for the elementary, middle, and high school 
teachers. Standard deviations ranged only from 0.46 
to 0.53. With 0.32 between the highest and lowest 
mean scores, there were no significant differences by 
school level. All three groups were very similar in 
their sense of perceived impact. 



Statistical comparison of the two administrations 
via an independent samples t test revealed a 
significant gain (0.37) for the high school respondents 
from their 1997 score of 3.57 (r [35] = 2.28, p < .05). 
Both the elementary and middle school scores 
increased from 1997, as well: 0.03 from the 

elementary mean of 3.59 and 0.05 from the middle 
school mean of 3.72. In sum, all three groups showed 
at least a marginal increase from their 1997 scores. 
See Figure 6 for a visual depiction of subscale means 
by grade level and year. 



Table 10: 1999 Impact Subscale 



Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.62 


0.46 


3.60 


-0.40 


Middle 


21 


3.77 


0.53 


3.80 


0.03 


High 


19 


3.94 


0.53 


4.00 


0.30 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 



Figure 6: Impact Subscale 
Means by Grade Level and Year 




Mean 
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School-Wide Professional 
Community (SWPC) 

Shared Sense of Purpose 

This 5 -item subscale measures the extent to which 
staff agree on and accept the central mission of the 
school. Descriptive statistics for this subscale are 
presented in Table 11. Respondents from all three 
school levels had means in the neutral range (3.49, 
3.45, and 3.68, respectively, for elementary, middle, 
and high), with standard deviations ranging from 0.53 
to 0.74. One caution to note is the negative skew 
values above 1.0 (-1.15 and -1.11) for the middle and 
high school teachers’ scores. The values indicate 
these were not normal distributions of scores, which 
could be attributable to the small sample size. 



With 0.23 between the highest and lowest mean 
scores, there were no significant differences by school 
level of respondent. All three groups were very 
similar in their sense of a common vision for the 
school. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. Both the 
middle and high school scores increased from 1997 
(3.30 and 3.59), with gains of 0.15 and 0.09, but the 
elementary score decreased 0.04 from 3.53 in 1997. 
For both years, the middle school score was the 
lowest. See Figure 7 for a visual depiction of subscale 
means by grade level and year. 



Table 1 1 : 1999 Shared Sense of Purpose Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.49 


0.60 


3.60 


-0.18 


Middle 


21 


3.45 


0.74 


3.60 


-1.15 


High 


19 


3.68 


0.53 


3.80 


-1.11 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 

Figure 7 : Shared Sense of Purpose Subscale 
Means by Grade Level and Year 



Elem 



Middle' 



High 




I 11997 



□ 1999 



1.00 



2.00 



3.00 



4.00 



5.00 




Mean 
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Collaborative Activity 

This 6-item subscale measures the extent to which 
staff share and coordinate curricula and activities both 
within and among schools. Descriptive statistics for 
this subscale are presented in Table 12. Respondents 
from all three school levels had means in the neutral 
range (3.35, 3.37, and 3.32, respectively, for elemen- 
tary, middle, and high), with standard deviations 
ranging from 0.48 to 0.66. With only 0.05 between 
the highest and lowest mean scores, there were no 
significant differences by school level of respondent. 



All three groups were very similar in their sense of 
collaboration. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. Both the 
elementary and middle school scores increased from 
1997 (3.33 and 3.27), with respective gains of 0.02 
and 0. 10, and the high school score remained the same 
at 3.32. See Figure 8 for a visual depiction of subscale 
means by grade level and year. 



Table 12: 1999 Collaborative Activity Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.35 


0.48 


3.50 


-0.59 


Middle 


21 


3.37 


0.66 


3.33 


0.48 


High 


19 


3.32 


0.55 


3.33 


0.39 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 



Figure 8: Collaborative Activity Subscale 



Means by Grade Level and Year 




Mean 




27 
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Collective Focus on Student Learning 

This 6-item subscale measures the degree to which 
teaching activities are geared toward instilling high- 
level authentic skills in students. Descriptive statistics 
for this subscale are presented in Table 13. 
Respondents from all three school levels had means in 
the neutral range (3.74, 3.39, and 3.61, respectively, 
for elementary, middle, and high), with standard 
deviations ranging from 0.44 to 1.00 (middle school). 
The elementary score of 3.74 was the highest mean in 
the SWPC subscales. With 0.35 between the highest 
and lowest mean scores, there were no significant 



differences by school level. All three groups were 
very similar in their sense of a collective focus on 
student learning. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. All three 
group scores did increase from 1997; the elementary 
0.16 from 3.58, the middle 0.29 from 3.10, and the 
high 0.20 from 3.41. For both years, the middle 
school group had the lowest subscale scores. See 
Figure 9 for a visual depiction of subscale means by 
grade level and year. 



Table 13; 1999 Collective Focus on Student Learning Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.74 


0.47 


3.83 


-0.80 


Middle 


21 


3.39 


1.00 


3.50 


-0.82 


High 


19 


3.61 


0.44 


3.67 


-0.52 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 




Figure 9; Collective Focus on Student Learning Subscale 
Means by Grade Level and Year 




Mean 

28 
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Deprivatized Practice 

This 7-item subscale measures the degree to which 
teachers use methods such as peer coaching, teamed 
teaching, and classroom observations to improve both 
classroom practice and collegial relationships. 
Descriptive statistics for this subscale are presented in 
Table 14. Respondents from all three school levels 
had means in the disagreement range (2.53, 2.68, and 
2.77, respectively, for elementary, middle, and high), 
with standard deviations ranging from 0.74 to 0.77. 
With 0.24 between the highest and lowest mean 
scores, there were no significant differences by school 
level of respondent. All three groups were very 



similar in their sense of sharing of practice, or lack 
thereof. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. Both the 
elementary and high school group scores increased 
from 1997: the elementary by 0.26 from 2.27 and the 
high by 0.11 from 2.66. The middle school score 
dropped by 0.15 from 2.83. For both years, the 
elementary school group had the lowest subscale 
scores. This subscale received the lowest scores on 
either the SPES or SWPC. See Figure 10 for a visual 
depiction of subscale means by grade level and year. 



Table 14: 1999 Deprivatized Practice Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


2.53 


0.77 


2.33 


-0.08 


Middle 


21 


2.68 


0.74 


3.00 


-0.13 


High 


19 


2.77 


0.74 


3.00 


-0.38 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 




Figure 10: Deprivatized Practice Subscale 
Means by Grade Level and Year 




Mean 
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Reflective Dialogue 

This 6-item subscale measures the extent to which 
teachers spend time thinking about and discussing 
their work and their ideas about teaching. Descriptive 
statistics for this subscale are presented in Table 15. 
Respondents from all three school levels had means in 
the neutral range (3.44, 3.45, and 3.48, respectively, 
for elementary, middle, and high), with standard 
deviations ranging from 0.47 to 0.75. With only 0.04 
between the highest and lowest mean scores, there 
were no significant differences by school level of 



respondent. All three groups were very similar in 
their sense of time spent on reflection. 

Statistical comparison of the two administrations 
via an independent samples t test did not reveal any 
significant differences from the 1997 scores. Both the 
elementary and high school group scores increased 
from 1997: elementary by 0.09 from 3.35 and high 
school by 0.32 from 3.16. The middle school score 
dropped an almost negligible 0.01 from 3.46. See 
Figure 1 1 for a visual depiction of subscale means by 
grade level and year. 



Table 15: 1999 Reflective Dialogue Subscale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


40 


3.44 


0.64 


3.67 


-0.31 


Middle 


21 


3.45 


0.75 


3.33 


-0.30 


ffigh 


19 


3.48 


0.47 


3.50 


0.09 



*Range of 1 (Strongly Disagree) to 5 (Strongly Agree). 




Figure 11: Reflective Dialogue Subscale 



Means by Grade Level and Year 




Mean 



30 



21 



Index of Perceived Organizational 
Effectiveness (IPOE) 

Descriptive statistics for the total scale for this 
instrument are presented in Table 16. Although the 
response stems are unique for each of the eight items, 
there is a common thread throughout in that higher 
scores on the 5 -point Likert-type scales indicate a 
higher perception of organizational effectiveness. 

Out of a possible score of 40, respondents from all 
three school levels had total mean scores of 23.42, 
23.81, and 27.67, respectively, for the elementary, 
middle, and high school teachers. Standard deviations 
ranged from 2.57 for the high school teachers to 5.24 
for the middle school. ANOVA results show a 
significant difference between the high school and 



both the elementary and middle school responses 
(F [2, 74] = 6.10, p < .01), indicating the high school 
teachers had higher perceptions of their school’s 
organizational effectiveness than their counterparts in 
the lower levels. 

Statistical comparison of the two administrations 
via an independent samples t test revealed a 
significant decrease (3.63) for the middle school 
respondents from their 1997 score of 27.44 (t [37] = 
-2.30, p < .05). The high school teachers’ score 
increased by 1.84 from 25.83, but the elementary 
score decreased 1.15 from 24.57. For both years, the 
elementary group had the lowest subscale scores. See 
Figure 12 for a visual depiction of the total scale 
means by grade level and year. 



Table 16: 1999 EPOE Total Scale 
Descriptive Statistics by Grade Level 



Level 


n 


Mean* 


Std. Dev. 


Median 


Skew 


Elementary 


38 


23.42 


4.54 


24.00 


-0.53 


Middle 


21 


23.81 


5.24 


26.00 


-0.39 


High 


18 


27.67 


2.57 


27.50 


0.65 



*Range of 8 to 40. 



Figure 12: IPOE Total Scale 
Means by Grade Level and Year 
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Overall Division Findings 

Previous sections in this report have presented 
posttest findings by subscale for each instrument 
administered in April 1999. Following is a summary 
of significant findings and effect sizes by survey, 
followed by correlations among the iristruments and 
their subscales. 

Summary of Sighificanf Findings and Effect Sizes 

SPES. The SPES instrument showed four 
statistically significant subscale gains for the high 
school teachers from the 1997 pretest to the 1999 
posttest: Decision Making, Status with Colleagues, 
Self-Efficacy, and Impact. These gains ranged from 
0.32 for Self-Efficacy to 0.53 for Decision Making. 
Effect sizes, defined as “the degree to which the 
phenomenon is present in the population” (Cohen, 
1977, p. 9) of an “indication for practical rneaning- 
fulness” (Fan, 1999) were also calculated for these 
significant t tests. Cohen’s guidelines for interpreting 
effect sizes were used for defining these figures: 
small = 0.2, medium = 0.5, and large = 0.8. The 
Decision Making gain of 0.53 had an effect size of 
1.29, well above Cohen’s “large” descriptor; both the 
Self-Efficacy and Impact subscale gains had large 
effect sizes, as well (0.86 and 0.82, respectively). The 
Status with Colleagues subscale gain was of medium 
size (0.61). These effect sizes, combined with statis- 
tical significance, indicate that the subscale gains were 
not due to chance and that the magnitude of the gains 
was substantial. See Table 17 for further detail. 

The SPES instrument also showed three 
statistically significant differences among the 1999 
schools. The high school teachers had a significantly 
higher score than the elementary teachers on the 
Decision Making subscale, with a small effect size of 
0.3 1 . Both the middle and high school teachers had 
significantly higher scores than the elementary 
teachers for the Status with Colleagues subscale, with 



a small effect size of 0.39. And, the elementary 
teachers had a significantly higher score than both the 
middle and high school teachers for the Autonomy in 
Scheduling subscale, with a small effect size of 0.45. 
These effect sizes indicate that statistical significance 
was not accompanied by much practical meaning- 
fulness or educational importance. See Table 18 for 
further detail. For a visual depiction of all SPES 
subscale means by a combination of year and grade 
level, see Figure 13 in Appendix B. 

SWPC. The SWPC instrument did not show any 
statistically significant subscale gains for the 
elementary, middle, or high school teachers from the 
1997 pretest to the 1999 posttest. Further, the 
instrument did not show any statistically significant 
differences among the 1999 schools. For a visual 
depiction of all SWPC subscale means by a combina- 
tion of year and grade level, see Figure 14 in 
Appendix B. 

IPOE. The IPOE instrument showed a statis- 
tically significant decrease for the middle school 
teachers’ score from the 1997 pretest to the 1999 
posttest, with a large effect size of 0.8 1 , indicating that 
the decrease was not due to chance and the magnitude 
of the loss was substantial. (This decrease of 3 .63 was 
the only significant decline for any of the groups 
across the three surveys.) See Table 17 for further 
detail. 

The IPOE instrument also showed a statistically 
significant difference among the 1999 schools. The 
high school teachers had a significantly higher score 
than both the elementary and middle school teachers, 
with a small effect size of 0.39, indicating that 
statistical significance was riot accompanied by much 
practical meaningfulness or educational itnportance. 
See Table 18 for further detail. For a visual depiction 
of the IPOE total scale means by a combination of 
year arid grade level, see Figure 15 in Appendix B. 
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Table 17: Significant Independent Samples t Test Results for the 
SPES Subscales and the IPOE Total Scale by Grade Level and Year 



Subscale 


Level 


Year 


n 


Mean 


Std. 

Dev. 


St.Er. 

Mean 


t 

Value 


df 


Sig. 


Score 

Diff 


Effect 

Size 


SPES 


High 


1999 


19 


3.61 


0.58 


0.13 


3.16 


35 


.003** 


0.53 


1.29 


Dc.Mkg. 




1997 


18 


3.08 


0.41 


0.10 












SPES 


High 


1999 


19 


4.16 


0.51 


0.12 


2.00 


35 


.053* 


0.36 


0.61 


Status 




1997 


18 


3.80 


0.59 


0.14 












SPES 


High 


1999 


19 


4.27 


0.42 


0.10 


2.46 


35 


.019* 


0.32 


0.86 


Self-Eff 




1997 


18 


3.95 


0.37 


0.09 












SPES 


High 


1999 


19 


3.94 


0.53 


0.12 


2.28 


35 


.029* 


0.37 


0.82 


Impact 




1997 


18 


3.57 


0.45 


0.11 












IPOE 


Middle 


1999 


21 


23.81 


5.24 


1.14 


-2.30 


37 


.027* 


-3.63 


0.81 


Total 




1997 


18 


27.44 


4.50 


1.06 








S' 





*p < .05 

**p< .01 



Table 18: Significant ANOVA Results for the 
SPES Subscales and the IPOE Total Scale by Grade Level 



Subscale 


df 


F 

Ratio 


Sig. 


Sig. Diff by School Levels 


Effect 

Size 


SPES Decision Making 


2, 77 


3.97 


.023* 


High > Elementary 


0.31 


SPES Status with Colleagues 


2, 77 


5.66 


.005** 


Middle and High > Elementary 


0.39 


SPES Autonomy in Scheduling 


2, 77 


8.20 


.001** 


Elementary > Middle and High 


0.45 


IPOE Total Scale 


2, 74 


6.10 


.004** 


High > Elementary and Middle 


0.39 



*;?<.05 
**;?<. 01 
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Correlations 

Table 19 presents the overall relationships 
among the three instruments for the posttest. The 
results show moderate positive correlations among the 
three measures (p < .001), all stronger than the pretest 
correlations. Although causal relationships cannot be 
ascertained, the data show a connection among 
empowerment, professional community, and perceived 
school effectiveness. These relationships support the 
concept of organizational capacity as an amalgamation 
of these three constructs. 

Table 20 presents a correlation matrix 
indicating the relationships among the SPES and 
SWPC subscales and the IPOE total scale. One of the 
most salient findings in this matrix is the number of 



process-oriented SPES and SWPC subscale variables 
positively correlated with the behavioral capacity 
IPOE variable of perceived school effectiveness. The 
matrix shows that 10 of the 1 1 subscales had moderate 
to low positive significant relationships with the 
concept, indicating that perceived organizational 
effectiveness increased as other subscale values rose. 
The only subscale not significantly correlated to the 
IPOE total scale was the SPES Autonomy in 
Scheduling (r = -.01, > .05). In fact, this subscale 

showed only two weak significant correlations in the 
entire matrix: with SPES Self-Efficacy {r = .23, p< 
.05) and SWPC Collective Focus on Student Learning 
{r= .30, p< .01). The strongest correlation was found 
between two SWPC subscales: Collective Focus on 
Student Learning and Shared Sense of Purpose 
(r=.65,/i<.001). 



Table 19: Correlation Coefficients Among the 
SPES, SWPC, and IPOE Instrument Scores 





SPES 


SWPC 


IPOE 


IPOE 


0.62*** 


0.56*** 


1.00 


SWPC 


0.56*** 


1.00 




SPES 


1.00 


•v' 

A.. ........ 





***/?< .001 
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Table 20: Correlation Coefficients Among the 



SPES and SWPC Subscales and the IPOE Total Scale 





SPES 

DcMk 


SPES 

Status 


SPES 

ProGr 


SPES 

Slf-Ef 


SPES 

Auton 


SPES 

Impact 


SWPC 

ShrPur 


SWPC 

Collab 


SWPC SWPC SWPC IPOE 
StdLm DepPr RfDia Total 


IPOE 

Total 


,31** 




.38** 


.26* 


-.01 


44*** 


58*** 


4Q*** 


.48*** .25* .25* 1.00 


SWPC 

RfDia 


.18 


.11 


.17 


.17 


.05 


59*** 


.18 


45*** 


.27* .50*** 1.00 ' 


SWPC 

DepPr 


.10 


.03 


-.03 


.06 


.11 


.21 


.07 


45*** 


.21 1.00 ” 

, 


SWPC 

StdLm 

SWPC 

Collab 

SWPC 

ShrPur 

SPES 

Impact 


.16 

.27* 

.27* 

.52*** 


.24* 

.16 

54*** 

42*** 


.32** 
.26* 
41 *** 

33** 


.28* 

.21 

.26* 

4^*** 


.30** 

.20 

.16 

.12 


.14 

.35** 

42*** 

1.00 


65*** 

46*** 

1.00 

Sitt 


.57*** 

1.00 

Mi 


T . «. ' 


SPES 

Auton 


.12 


-.09 


-.01 


.23* 


1.00 


:f®l 




§mm 


iiililla«iiw 


SPES 

Slf-Ef 




33** 


4^*** 


1.00 




l-V, 


mi 


illl; 


Pif 1 P t' 


SPES 

ProGr 

SPES 

Status 

SPES 

DcMk 


1.00 


.36** 

1.00 


1.00 


ill 




V 


pit IJ'S' 

III 


llffi 

fill 





*p < .05 
**/?<. 01 
***/?<. 001 




35 
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FINDINGS BY SCHOOL 



Previous sections have reported findings only at taken place in RCPS. Comparisons can be made to the 
the /eve/ for each instrument, but attention is baseline portraits created in 1997. Descriptive 

now given to individual items by school in order to statistics can be found for each item by school level in 

provide a “portrait” ofeach school now that two years Table 21 in Appendix C. 
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CONCLUSIONS 



A number of individual conclusions can be drawn 
from the findings presented earlier. These conclusions 
are presented below. 

Given the Cronbach alpha reliability estimates 
obtained for the overall posttest scores, we conclude 
there was satisfactory reliability in this administration 
of the three instruments. 

Since 1997, the project’s technical assistance 
interventions may have had an impact on several of 
the areas under study. Based on the high school 
teachers’ increased scores in decision making, self- 
efficacy, status, and impact, we conclude that 
improved conditions and practices at the high school 
have led to a heightened sense of empowerment, 
recognizing that a change in leadership may also have 
influenced perceptions of empowerment. 

Based on the slight fluctuations in teachers’ mean 
scores from 1997 to 1999, it can be concluded that 
there was little measurable change in the area of 
professional learning community since 1997. Further, 
based on the consistent 1999 ratings by the 
elementary, middle, and high school teachers, we 
believe that a division-wide consensus of mediocrity 
exists in this area, which may be difficult to 
ameliorate given the high faculty turnover rate. 

Based on the decline in middle school teachers’ 
organizational effectiveness score since 1997, we 
conclude that their views regarding their school’s 
organizational effectiveness have become more 
discerning over the past two years. Possibly, as they 
became more aware of the elements that comprise 
organizational effectiveness, they developed a more 
realistic view of existing school conditions, resulting 
in a decreased score. Given the minimal changes in the 



elementary and high school teachers’ scores from 
1997 to 1999, we believe that teacher viewpoints 
in those schools remained constant over time. 
Furthermore, improvement may be difficult to achieve 
in this area, given teachers’ low perceptions of the 
ability of their faculties to modify behaviors as a result 
of change. 

Based on 1999 scores, we conclude that high 
school teachers perceived themselves to have greater 
decision-making authority than did the elementary 
teachers, both the middle and high school teachers had 
higher perceptions of status than did the elementary 
teachers, and the elementary teachers experienced 
more autonomy in scheduling than did either the 
middle or high school teachers. Furthermore, the high 
school teachers had higher (but still relatively 
moderate) perceptions of their school’s organizational 
effectiveness than did either the elementary or middle 
school teachers. 

The lowest-scoring subscale in 1999 (and in 1997) 
was deprivatized practice (SWPC professional 
learning community); therefore, it can be concluded 
that this area merits further investigation of existing 
division conditions. The middle school teachers’ 
declining score in this area further substantiates the 
need to identify barriers to teachers’ use of shared- 
practice techniques such as peer coaching, team 
teaching, or classroom observations. 

Given the instrumentation used in this study, we 
conclude that overall, since 1997, the RCPS division 
has expanded its organizational capacity by making 
concrete progress in the area of teacher empowerment 
and minimal progress in the areas of creating 
sustainable professional learning communities and 
increasing organizational effectiveness. 
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RECOMMENDATIONS 



A number of recommendations can be made based 
on the findings and conclusions of this study about the 
RCPS division’s organizational capacity for change. 

Staff need to examine district and school 
conditions, especially at the middle school, that 
impede the deprivatization of practice and try to 
remove those hurdles in order to create a non- 
threatening environment for teachers to participate in 
classroom visits. 

District and school conditions should be examined 
to identify barriers that seem to preclude creating a 
sustainable professional learning community. 

Staff need to explore district and school 
conditions, especially at the middle school, that may 
impede efforts to increase organizational effectiveness 
and try to remove those hurdles in order to facilitate 
improvement. 

Teachers should be involved in discussions about 
ways to retain staff and decrease the high turnover rate. 

Administrators need to provide time and establish 
expectations for teachers to work together to make 
decisions about the K-12 curriculum and instruction. 

Teachers need to ensure that they are teaching 
higher-level skills by incorporating these skills into 
the curriculum. Otherwise, it is unlikely that students 
will pass the Standards of Learning assessments, 
which require such skills, and thus will not be 
prepared to enter the workforce of the 21st century. 



School administrators should focus on developing 
opportunities for collaboration between themselves 
and teachers, and on supporting teachers’ efforts to 
collaborate with their peers both within and among 
schools. 

As the district responds to the state guidelines in 
order to maintain accreditation, teachers and adminis- 
trators must develop the skill of collaborating with 
staff in other schools in order to offer students the 
types of activities and curriculum elements that will 
lead to successful performance on the Standards of 
Learning assessments. 

School structures and processes that encourage 
teachers to share ideas and learn from one another are 
essential for building collaboration and need to be put 
in place. 

Administrators should continue providing common 
planning periods for teachers and ensuring use of that 
time for collaboration on instructional themes, activ- 
ities, and lesson plans within schools and grade levels. 

Administrators and others need to lead teachers 
toward a collective focus on student learning. 

Teachers need more time to spend together 
discussing the improvement of teaching and learning 
in their respective schools. 

Staff need to be involved in articulating the shared 
beliefs, goals, and values of the division as a whole 
and of the individual schools. 
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APPENDIXES 



Appendix A: 

The Teacher, School, and School 
Organization Questionnaire 



The Teacher, School, and School Organization Questionnaire 



Last Four Social Security Numbers: 



Were you working at this school in April 1 997? — Y es — No 



Directions: This questionnaire concerns your perceptions of how you view your teaching role. There are no 
right or wrong answers. Please read each numbered statement carefully. Then respond by circling one of 
the responses on the scale of Strongly Disagree (SD) to Strongly Agree (SA). Please do not skip any 
statements. 

Strongly Disagree (SD) Disagree (D) Neither Disagree nor Agree (N) Agree (A) Strongly Agree (SA) 



1 . lam given the responsibility to monitor programs. 

SD D N A SA 

2. I function in a professional environment. 

SD D N A SA 

3. I believe that I have earned respect. 

SD D N A SA 

4. I believe that I am helping kids become independent 
learners. 

SD D N A SA 

5. I have control over daily schedules. 

SD D N A SA 

6. I believe that I have the ability to get things done. 

SD D N A SA 

7. 1 make decisions about the implementation of new 
programs in school. 

SD D N A SA 



O 

ERIC 



8. 1 am treated as a professional. 

SD D N A SA 

9. I believe that I am very effective. 

SD D N A SA 

10. I believe that I am empowering students. 

SD D N A SA 

11. lam able to teach as I choose. 

SD D N A SA 

12. 1 participate in staff development. 

SD D N A SA 

13. I make decisions about the selection of other teachers 
for my school. 

SD D N A SA 

14. 1 have the opportunity for professional growth. 

SD D N A SA 
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15. I have the respect of my colleagues. 

SD D N A SA 

16. 1 feel that I am involved in an important program for 
children. 

SD D N A SA 

17. 1 have the freedom to make decisions on what is taught. 

SD D N A SA 

18. I have grown professionally during the past year. 

SD D N A SA 

19. I believe that I am having an impact. 

SD D N A SA 

20. 1 believe in the value of professional development for 
teachers. 

SD D N A SA 

21. lam involved in school budget decisions. 

SD D N A SA 

22. I work at a school where kids come first. 

SD D _ N A SA 

23. I have the support and respect of my colleagues. 

SD D N A SA 

24. I see students learn. 

SD D N A SA 

25. I make decisions about curriculum. 

SD D N A SA 

26. I am a decision maker. 

SD D N A SA 

27. 1 am given the opportunity to collaborate with other 
teachers. 

SD D N A SA 

28. 1 have a strong knowledge base in the areas in which I 
teach. 

SD D N A SA 

O 
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29. I believe that I have the ability to grow by working daily 
with students. 

SD D N A SA 

30. I perceive that I have the opportunity to influence others. 

SD D N A SA 

31. I can determine my own schedule. 

SD D N A SA 

32. 1 have the opportunity to collaborate with other teachers 
in my school. 

SD D N A SA 

33. I perceive that I am making a difference. 

SD D N A SA 

34. Principals, other teachers, and school personnel solicit 
my advice. 

SD D N A SA 

35. I believe that I am good at what I do. 

SD D N A SA 

36. 1 can plan my own schedule. 

SD D N A SA 

37. I perceive that I am having an impact on other teachers 
and students. 

SD D N A SA 

38. My advice is solicited by others. 

SD D N A SA 

39. I have an opportunity to teach other teachers about 
innovative ideas. 

SD D N A SA 

40. Most of my colleagues share my beliefs and values 
about what the central mission of the school should be. 

SD D N A SA 

41. Goals and priorities for the school are clear. 

SD D N A SA 
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42. The district's vision for its schools is accepted by 
teachers and administrators. 

SD D N A SA 

43. In the district's schools, the teachers and the 
administration are in close agreement on achievement 
standards and grading policies. 

SD D N A SA 

44. There is close agreement among teachers and 
administrators on expectations for student learning in 
this district. 

SD D N A SA 

45. 1 receive many useful suggestions for curriculum 
materials from colleagues in my school, department, 
unit, or district. 

SD D N A SA 

46. 1 receive many useful suggestions for teaching 
techniques or student activities to share from colleagues 
in my school, department, unit, or district. 

SD D N A SA 

47. There is a great deal of cooperative effort among staff 
members in my school, department, unit, or district. 

SD D N A SA 

48. I make a conscious effort to coordinate the content of my 
courses across the district's schools. 

SD D N A SA 

49. In a typical planning period with others in my district, the 
group decides common themes and suggests related 
materials and activities to guide instruction in the 
district's schools. 

SD D N A SA 

50. i meet often with others in my district regarding lesson 
planning, curriculum development, guidance and 
counseling, evaluation of programs, or other 
collaborative work related to instruction. 

SD D N A SA 



51. Higher level skills (reasoning, problem solving, critical 
thinking) are important student goals of our district's 
students. 

SD D N A SA 

52. Creative thinking is an important student goal for our 
district's students. 

SD D N A SA 

53. Teachers in our district focus on what and how well 
students are learning rather than on how they are 
teaching. 

SD D N A SA 

54. Teachers in our district exhibit a reasonably focused 
commitment to authentic curriculum and instruction. 

SD D N A SA 

55. Teachers in our district exhibit a reasonably focused 
commitment to authentic assessment. 

SD D N A SA 

56. A focused school vision for student learning is shared by 
most staff in the schools in our district. 

SD D N A SA 

57. Two or more colleagues in the building regularly observe 
my work in schools and give me meaningful fe^back. 

SD D N A SA 

58. Other than formal evaluation, my supervisor(s) regularly 
observe(s) my work in schools and give(s) me 
meaningful feedback. 

SD D N A SA 

59. I have often been visited by a peer from another school 
to observe and discuss my teaching/leaming situation. 

SD D N A SA 

60. 1 have often been visited by a peer from another 

classroom to observe and discuss my teaching/leaming 
situation. 

SD D N A SA 
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61. I have often visited a peer's school to observe and 
discuss his/her teaching/leaming situation. 

SD D N A SA 

62. 1 have often visited a peer’s classroom to observe and 
discuss his/her teaching/leaming situation. 

SD D N A SA 

63. 1 receive informal, meaningful feedback on my 
performance from my peers. 

SD D N A SA 

64. In a typical planning period with other teachers, the 
group discusses problems of specific students and 
arranges appropriate help. 

SD D N A SA 

65. In a typical planning period with peers, the group 
discusses specific teaching practices and behaviors of 
team members in our district. 

SD D N A SA 



66. In formal and informal meetings of peers, the group 
discusses the goals of tho schools in our district. 

SD D N A SA 

67. In formal and informal meetings of peers, the group 

discusses the teaching profession. 

SD D N A SA 

68. In formal and informal meetings of peers, the group 
discusses how students learn. 

SD D N A SA 

69. In formal and informal meetings of peers, the group 
discusses the evaluation of student learning. 

SD D N A SA 



Directions: These questions concern your perceptions of your school's overall effectiveness. There are no right or wronjg 
answers. Every educator and staff member produces something during their work in the school. The following ■products" 
and services are just a few of the things that result from schools’ work. 

Lesson Plans Student Learning Co-Curricular Activities 

Curriculum Community Projects Parent Involvement 

Art & Music Programs Instruction Clean Schools 



Please indicate your response to each of the questions by circling a number from 1 (low) to 5 (high) on the scale 
provided under the question or by first marking an “X” on the scale. 



Of the various things produced by the people 
you know in your school(s), how much are 
they producing? 


Low 

Production 

1 


Fairly Low 
Production 

2 


Moderate 

Production 

3 


High 

Production 

4 


Very High 
Production 

5 


How good is the quality of the products or 
services produced by the people you know in 


Poor Quality 


Low 

Quality 


Fair 

Quality 


Good Quality 


Excellent 

Quality 



your school(s)? 1 2 3 4 ® 



ERIC 



57 



72. Do the people in your school(s) get maximum Not Efficiently Not Very 
output from the available resource (money, Efficiently 

people, equipment, etc.)? That is, how 
efficiently do they do their work? ’ 



Fairly Very Efficiently 
Efficiently 

3 4 



73. How good a job is done by the people in your 
school(s) in anticipating problems and 
preventing them from occurring or minimizing 
their effects? 

74. How informed are the people in your school(s) 
about innovations that could affect the way 
they do their work? 



75. When changes are made in methods, 
routines, or equipment, how quickly do the 
people in your school(s) accept and adjust to 
the changes? 

76. How many of the people in your school(s) 
readily accept and adjust to the changes? 



Poor Job 


Adequate Job 


Fair Job 


Very Good Job 


1 


2 


3 


4 


Uninformed 


Somewhat 

Informed 


Moderately 

Informed 


Informed 


1 


2 


3 


4 


Very Slowly 


Rather Slowly 


Fairly Rapidly 


Rapidly 


1 


2 


3 


4 


Few. If Any 


Less Than Half 


About Half 


More Than Half 


1 


2 


3 


4 



77. How good a job do the people in your 

school(s) do in coping with emergencies and 
disruptions? 

78. What is your role in the school(s)? ( check only one) 

Community Organization Representative 

Principal/Assistant Principal 

Classroom Teacher 

Itinerant Teacher (not at Bldg, full time) 

School Staff (secretary, custodian, cook) 

Curriculum Supervisor 

Other (Explain; 



Poor Job Adequate Job Fair Job Very Good Job 

12 3 4 



Student 

Counselor/Psychiatrist 
Teacher's Aide 
Title I Teacher 
Assistant Superintendent 
Department Head/Chair 
) 



79. If classroom teacher, what subject(s) do you teach? 




Extremely 

Efficiently 

5 

Excellent 

Job 

5 

Very 

Informed 

5 

Immediately 

5 

Almost 

Everyone 

5 

Excellent Job 
5 
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80. Check the school(s) in which you teach. 

elementary middle school high school 

81. Counting this year, how many years have you taught in this school? 

82. Counting this year, how many years have you taught, administered, or supervised in any school? — 

83. Counting this year, how many years have you taught, in this school district? (Skip if not applicable) 

84. Do you teach full time or part time? (Mark one: Skip is not applicable) 

Full Time Part Time 

85. Check the one category that describes how many diplomas, degrees, and credits you have now. 

Bachelors — Masters 

Bachelors + 1 5 or more Masters + 1 5 or more 

Education Specialists Degree 

Doctors Degree 

Other (Explain) 

86. Check one: Female Male 

87. Your age is years. 



Thank you for completing this questionnaire! 
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Appendix B: 

SPES and SWPC Subscale Bar Charts 
and IPOE Total Scale Bar Chart by a 
Combination of Year and Grade Level 
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Appendix C: 

Table 21: Descriptive Statistics for 
Individual Survey Items 



Table 21 : Descriptive Statistics for Individual Survey Items 
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Citation Form 



I 

I 

I 

i 



e Program Evaluation Standards (1994, Sage) guided the development of this (check one): 

request for evaluation plan/design/proposal 
evaluation pian/design/proposai 
evaluation contract 
evaluation report 

other: 



X 



1 0 interpret the information provided on this form, the reader needs to refer to the full text of the standards as they appear In Joint 
ommittee on Standards for Educational Evaluation, The Program Evaluation Standards (1994), Thousand Oaks, CA, Sage. 

he Standards y^ere consulted and used as indicated in the table below (check as appropriate): 
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deemed applicable 
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cable. 
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Evaluator Credibility 
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Practical Procedures 
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Conflict of Interest 
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